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ABSTRACT 

Algebra I and General Mathematics courses using 
tutorial instructional programs under computer control supplemented 
by ••off-line" materials (included in the computer controlled testing) 
have been developed for a ninth grade student population. The 
relationships of instructional materials, pretests, posttests, and 
choice points are illustrated by flow charts for a chapter and are an 
instructional unit within a chapter. The personnel, facilities, and 
procedures for course correction and revision are briefly summarized, 
and tables provide a description of the completeness of the coiurses, 
the evaluation plans, and a few very preliminary findings. (EM Oil 
037 through EM Oil 043, EM Oil 0U6, EM Oil 0U7, and EM Oil 049 
through EM Oil 058 are related documents. The preliminary report of 
the previous year, 1970, can be found as EM Oil 046.) (RH) 
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Course Development 

The Algebra I and General Mathematics course hove '^een developed for a 
ninth grade student population. The essential innovative feature of these courses 
is a tutorial instructional program under computer control. The "on-line" program 
is supplemented by a variety of more conventional individualized learning experiences. 

The pupils receive basic instruction in mathematical concepts from the computer- 
assisted instructfon (CAI) program. A record of the pupil's interaction with the CAI 
program is stored in the computer. These performance data serve to direct the flow 
of the "on-line" instruction. The pupil whose performance indicates rapid acquisi- 
tion of the mathematical concepts, by-posses the detailed instruction required to 
bring a less able student to criterion. 

The course material in the CAI program has been organized into chapters 
similar to the chapters in a textbook. The chapters hove been subdivided into 
instructional blocks. The attached flowcharts (Appendix A) illustrate the structure 
of a chapter and an instructional block within a chapter. 

A preskills test will test the prerequisite skills taught in prior chapters of 
the current course and the more sophisticated concepts introduced in previous 
mathematics courses. They will not test for the basic arithmetic operations that 
all pupils should have acquired by this po'nt in their schooling. Experience has 
shown that some pupils will be deficient in these skills. It will be the teochers' 
responsibility to identify these pupils. On-line drill programs in the basic operations 
are available for the practice necessaiy to develop proficiency witK the basic 
arithmetic operational skills. 
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As indicated in Flowchart I, remediol instruction will be provided in the area 
indicated by inadequate performance on the preskills tests. The remedial instruction 
will be provided on-line if the appropriate instruction exists; otherwise, off-line 
material will be available to provide remediation. 

Flowchart II illustrates the structure and program flow for an instructional 
block. The number of concepts presented in an instructional block was determined 
from an analysis of the student records obtained from the Lincoln and Schenley CAI 
classes during the 1969-70 school year. 

The essential features of an instructional block are the pretests, instruction, 
practice, summary, criterion quiz, and an option to return to a previous instructional 
sequence within a block if criterion on that block was not attained. A pupil has 
an option to take a pretest or to go directly H instruction. If a pretest is taken 
and criterion is met, the program skips to the nex* instructional block. 

When a summary is completed, the pupil is referred to off-line material 
that will provide additional practice on the concepts presented in the instruction. 
When the pupil has completed the off-line assignment and returns to the on-line 
program, a criterion quiz will be administered. If criterion is met, the program 
proceeds to the next instructional Slock. If criterion is not met, an option to 
repeat all or part of the material previously presented in that instructional block 
IS available. A second fatlure of the criterion quiz will result in an additional 
off-line assignment being given by the program. If criterion is not met on the 
third iteration of the quiz, the program proceeds to the next instructional block. 

A major effort has been made to provide off-line materials in addition to 
the practice materials presented in the regular assignments. The additional material 
is designed to supplement the basic instruction by introducing topics not presented 
on line. These materials include filmstrips, mathematical games, programed 
instruction materials, printed materials, and manipulative materials. 

Tests have been developed for on-line administration at the end of each 
chapter of the olgebra and general mathematics courses. The test items parallel 
the format and the content of questions presented in the instructional program. 
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THe chapter tests should be viewed as criterion tests for the chapters. If a pupil's 
performance is unsatisfactory, the areas of difficulty may be identified by the 
teacher and remedial activities prescribed. 

A mid-course test is administered on line at the end of Chapter Five in General 
Mathematics and at the end of Chapter Four in Algebra. The items of the mid*course 
tests parallel items presented in the previous chapter tests. 

Course Correction and Revision 

The major effort of the Penn State staff is directed to revising rhe structure 
of the existing instrjctional program to conform to the format presented in the 
flowcharts. IVeskills tests, pretests, criterion quizzes, and summaries did not 
exist as unique features in the original version of the program. These items must be 
written and incorporated in the computer program. 

Computer programs are being written to accommodate the instructional 
material that has not been previously programed. Extensive revisions to the 
content of Chapters Five and Seven in Algebra and Chapters Five, Eight, and 
Nine in General Mathemotics are being made. 

Personnel 

Professor Lars Jansson, mathematics educator in the College of Education, 
has assumed the responsibility for the content of the instructional Materials. He 
is assisted by Consortium staff members who have had experience teaching high 
school mathematics. 

Facilities 

An IBM 1500 system with thirty 1510 instructional stations with typewriter 
keyboard and light pens and thirty image projectors is operating at Lincoln and 
Schenley High Schools. The Consortium staff continued to use approximately 
45 per cent of Penn State's CAI syttem during the present report period. 
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Schedule 

The schedule for revising the course material is provided in Appendix B. 
Evaluation 

An evaluation of the CAI algebra and general mathematics courses at 
Lincoln and Schenley High Schools began in September, 1970, The variables to be 
measured are mathematics achievement, attitude toward mathematics and attitude 
toward CAI. Two tests will be used to measure achievement in mathematics — 
The Cooperative Mathematics Test, Algebra I, and the Stanford Achievement 
Test, Form X, Non-standardized tests which contain items that parallel items 
presented in the CAI courses chapter tests, were developed for algebra and general 
mathematics. Attitude toward mathematics is measured by the Attitude Toward 
Mathematics test developed by Professors Marilyn N. Suydam and Cecil Trueblood 
of the Penn State College of Education faculty. An instrument to measure attitude 
toward CAI was also developed by Pkrofessor Suydam. 

The achievement and attitude toward mathematics of the pupils in the 
CAI courses is to be compared with the achievement in cohort groups receiving 
conventional instruction in Algebra I and General Mathematics, The cohort 
groups in Philadelphia were obtained from conventional classes at Lincoln High 
School. Since all of the students enrolled in Algebra I and General Mathematics 
at Schenley received instruction in CAI classes, cohort groups were obtained from 
conventional dosses in Peabody High School, Pittsburgh. The student population 
at Peabody is assumed to be comparable to the student population at Schenley. 

The status of the evaluation and a tentative schedule for the administration 
of posttests is provided in Appendix C. 
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Appendix C 

Consortium Evaluation 
Status as of February 28, 1 971 



1 . Data from the achievement pretests on both non-standardized and standardized 
tests. 



School 


Course 


Group 


Test* 


n 




r 


Sc hen ley 


Gen mo 


CAI 


non-Stan. 


131 


14.33 


.73 


Peobody 


Genmo 


cohort 


non-ston. 


82 


14.67 


.69 


Sc hen ley 


Genmo 


CAI 


Stan. 


131 


13.99 


.87 


Peobody 


Genmo 


cohort 


Stan. 


88 


12.48 


.76 


Lincoln 


Genmo 


CAI 


non-ston. 


220 


15.20 


.59 


Lincoln 


Genmo 


cohort 


non-ston. 


69 


15.10 


.75 


Lincoln 


Genmo 


CAI 


Stan. 


218 


14.25 


.67 


Lincoln 


Genmo 


cohort 


Stan. 


68 


13.63 


.70 


Sc hen ley 


Algeb 


CAI 


non-Stan. 


247 


9.30 


.30 


Peobody 


Algeb 


cohort 


non-Stan. 


93 


12.27 


.62 


Schenley 


Algeb 


CAI 


Stan. 


249 


8.64 


.35 


Peobody 


Algeb 


cohort 


Stan. 


97 


11.33 


.58 


Lincoln 


Algeb 


CAI 


non-Stan. 


219 


10.77 


.45 


Lincoln 


Algeb 


cohort 


non-ston. 


104 


9.95 


.48 


Lincoln 


Algeb 


CAI 


Stan. 


221 


10.66 


.57 


Lincoln 


Algeb 


cohort 


Stan. 


100 


10.35 


.55 



* Genmo non-standardized test has 33 items 
Genma standardized test has 45 items 

Algeb non -standardized test has 32 items 
Algeb standardized test has 40 items 
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2. Data from the second administration of the Attitude Toward Mathematics scale 
in Philadelphia. 



School 


Course 


Group 


n 




low 
attitude 


high 
attitude 
~X 


r 


Lincoln 


Genma 


CAI 


201 


79.55 


61.86 


97.20 


.92 


Lincoln 


Genma 


cohort 


77 


76.88 


55.82 


96.62 


.93 


Lincoln 


Algeb 


CAI 


201 


87.13 


67.98 


105.23 


.94 


Lincoln 


Aigeb 


cohort 


71 


78.32 


59.05 


97.00 


.93 


3. Data from the second administration of th 
Instruction scale in Philadelphia. 


e Attitude Toward Computer Assisted 


School 


Course 


Group 


n 


X 


low 
attitude 
X 


high 
attitude 
X 


r 


Lincoln 


Genma 


CAI 


201 


86.54 


71.72 


101.19 


.86 


Lincoln 


Algeb 


CAI 


201 


90.06 


74.38 


104.03 


.90 



4. While nc statistical analyses of the attitude scale data from Philadelphia hove 
been done, inspection indicates that there was: 

on the mathematics scale 

a slight increase in the CAI genma mean (from 76.38 to 79.55) 
a minimal change in the cohort genma mean (From 76.55 to 76.88) 
a minimol change in the CAI algeb mean (from 87.74 to 87. 13) 
a slight decrease in the cohort algeb mean (from 84.53 to 78.32} 

on the CAI scale 

a slight decrease in the CAI genma mean (from 89.77 to 86.54) 
a slight decrease in the CAI algeb mean (from 92. 13 to 90.06) 
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L A tentative schedule for administration of posttests has been determined: 



test or scale 



course 



Attitude Toward 
Mathematics 

Attitude Toward 

Instructional 

Setting 



gen. math 
and algebra 

gen • math 
and algebra 



Stanford Achieve- gen. math 
ment Test, Form W 



Non*standard ized 

Hftst. Parts A 
and B 

Cooperative 
Algebra Test, 
Form 1-^B 

Non-standardized 
posttest 



gen. math 



algebra 



algebra 



groups 



Attitude Toward genma and CAI only 
CAI algeb 



CAI and 
cohort 

CAI and 
cohort 



CAI and 
cohort 

CAI and 
cohort 



CAI and 
cohort 



CAI and 
cohort 



administration 

date: 
Pittsburgh 



administration 

date: 
Philadelphia 



as students on as students on 

CAI complete CAI complete 

the program, or the program, or 

during the weeic during the weeR 

of May 31 of June 14 



June 7 



June 7 



June 8 



June 9 



J.r- 8 



June 9 



June 21 



June 21 



June 22 



June 23 



June 22 



June 23 



It should be noted that the tests are scheduled to be given in Philadelphia after 
the ending date of the project. It would seem impossible to analyze data and 
prepare a final report before the end of July at the earliest. 

II. In analyzing the data, we plan to attempt answers to questions such as: 

1 . Questions to be answered: 

a. Is there a difference between groups following CAI or non-CAl 
instruction? 



(1) achievement 
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(a) Piftsburgh genma 

(b) Pittsburgh algeb 

(c) Philadelphia genma 

(d) Philadelphia algeb 

(2) attitude 

(a) Pittsburgh genma 

(b) Pittsburgh algeb 

(c) Philadelphia genma 

(d) Philadelphia algeb 

b. Is CAI more effective for those of low or high ability? 

c. Is CAj Tiore effective for those with low or high achievement? 

d. Is achievement/attitude related to previous achievement? 

e- Is achievement/attitude related to attendance? (for eoch student, 
independent of time on-line) 

f. Is achievement/attitude related to numoer of years in school? 

g. Is.achievement/attitude related to time on-line? (How fast could 
they have finished?) 

2. Data to be collected 

a. Achievement 

(1) Standa 'dized test: pre, post (per group) 

(2) Non -standardized test: pre, post (per group) 

b. Attitude 

(1) Toward mathematics: pre, mid?, post (per group) 

(2) Toward CAI: pre, mid, post (per CAI group) 

(3) Toward setting: post (per group) 

Intelligence (|Q; ability)(per group)* 

d. Previous achievement (per group) 

e. Attendance (per group) 
JF. Years in school (per group) 

g. Time on-line (per CAI group) 



from 
— school 
records 
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3. Statistical analysis 

a. Correlational matrix with gain scores (COV; multiple regression; 
multivariate analysis; QSASE) 

b. Identify covariates 

c. AOV on scores adjusted for multiple covariates 

4. Guidelines 

a. No analyses between Pittsburgh and Philadelphia 

b. Gain scores; repeated measures; provide range-distribution of 
scores 

c. Supplement with classroom descriptions; discuss why students 
not independent; graphs; ''dramatic cases" 

d. Use data only from those taking all tests (identify why n is 
decreased) 
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